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@> Method and system for location dependent verbal command execution in a computer based control 
system. 



(5?) A method and system for location dependent 
verbal command execution in a computer 
based control system within an installation hav- 
ing multiple physical locations. A specified 
function within each physical location, such as 
a lighting fixture or alarm setting, may be con- 
trolled by a selected verbal command. A micro- 
phone within each room or physical location 
within the installation is utilized to detect each 
utterance of a verbal command and the volume 
of each verbal command is determined for each 
physical location at which that command is 
detected. Thereafter, the physical location hav- 
ing the highest volume for a detected verbal 
command is identified and the specified func- 
tion is controlled at only that location. In the 
event multiple speakers simultaneously utter an 
identical verbal command at different physical 
locations, the location of maximum volume is 
determined for each speaker and the specified 
function is controlled at only the maximum 
volume location associated with each speaker. 
In this manner, a single verbal command may be 
utilized to control an identical function at multi- 
ple locations within an installation in a location 
dependent manner. 
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The present invention relates in general to an im- 
proved computer based control system and in partic- 
ular to an improved computer based control system 
which may be operated utilizing verbal commands. 
Still more particularly, the present invention relates to 5 
a method and system for location dependent verbal 
command execution in a computer based control sys- 
tem. 

Computers are becoming increasingly ubiquitous 
in the modern world. The introduction of the so-called 10 
"personal" computer has greatly enhanced the avail- 
ability of computing power to the ordinary consumer. 
As these computers become more commonplace a 
greater number of applications for this computing 
power is available to the consumer. 15 

For example, in addition to word processing, 
mathematical calculation and computer aided draft- 
ing or manufacturing applications personal comput- 
ers are increasingly utilized to control various func- 
tions in the modern household. In an effort to make 20 
such devices increasingly "userf riendly" the interface 
between the user and the computer has been rapidly 
developing in many areas. 

One technique for decreasing the complexity of 
the interface between a user and a computer is the 25 
utilization of interface techniques which are intuitive 
and easily understood by those who are not skilled in 
the computer arts. Intuitive interfaces, such as a 
graphical user interface or a verbal command inter- 
face are becoming increasingly common. For exam- 30 
pie, speech recognition software now exists which 
makes it possible for a computer system to be 
"trained" to recognize selected words or phrases. 
One example of this technology is presently available 
within cellular telephones installed within automo- 35 
biles. A user may, utilizing verbal commands, auto- 
matically dial a particular location or specified num- 
ber without requiring manual input of that data to the 
cellular telephone system, greatly enhancing system 
efficiency and user safety while driving an automo- 40 
bile. 

In a similar application, the utilization of a com- 
puter for the creation of a so-called "smart house" has 
also been proposed in conjunction with a verbal com- 
mand interface; however, the number of locations and 45 
functions to be controlled utilizing a computer in such 
an application is somewhat greater than the functions 
typically present within a telephone system or other 
simple application. A computer based control system 
implemented within a "srtiart house" will allow appli- 50 
ances and electrical systems, such as lighting or 
alarm systems to be operated by voice control. 

Known voice control systems require a unique 
command for each unique function and thus such a 
system requires a different command to operate a 55 
similar function in different areas within the house or 
installation area. For example, a unique command is 
required to operate the lighting fixture within one bed- 



room of a house and a separate unique command 
would be required to operate thejighting system with- 
in another bedroom in the house, this requirement re- 
sults in an increased complexity due to the fact that 
the system must be trained to recognize a larger num- 
ber of verbal commands and thus the system memory 
requirements and processing complexity are greatly 
increased. 

It should therefore be apparent that it would be 
advantageous to provide a computer based control 
system which utilizes verbal commands in a location 
dependent manner. 

It is therefore one object of the present invention 
to provide an improved computer based control sys- 
tem. 

It is another object of the present invention to pro- 
vide an improved computer based control system 
which may be operated utilizing verbal commands. 

It is yet another object of the present invention to 
provide an improved method and system for location 
dependent verbal command execution within a com- 
puter based control system. 

The foregoing objects are achieved as is now de- 
scribed. A method and systerh are disclosed for loca- 
tion dependent verbal command execution in a com- 
puter based control system within an installation hav- 
ing multiple physical locations. A specified function 
within each physical location, such as a lighting fix- 
ture or alarm setting, may be controlled by a selected 
verbal command. A microphone within each room or 
physical location within the installation is utilizecyo 
detect each utterance of a verbal command and tjtje 
volume of each verbal command is determined for 
each physical location at which that command is de- 
tected. Thereafter, the physical location having the 
highest volume for a detected verbal command is 
identified and the specified function is controlled at 
only that location. In the event multiple speakers si- 
multaneously utter an identical verbal command at 
different physical locations, the location of maximum 
volume is determined for each speaker and the spe- 
cified function is controlled at only the maximum vol- 
ume location associated with each speaker. In this 
manner, a single verbal command may be utilized to 
control an identical function at multiple locations with- 
in an installation in a location dependent manner. 

The above as well as additional objectives, fea- 
tures, and advantages of the present invention will 
become apparent in the following detailed written de- 
scription. 

The novel features believed characteristic of the 
invention are set forth in the appended claims. The in- 
vention itself, however, as well as a preferred mode 
of use, further objectives and advantages thereof, will 
best be understood by reference to the following de- 
tailed description of an illustrative embodiment when 
read in conjunction with the accompanying drawings, 
wherein: 
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Figure 1 is a pictorial representation of a comput- 
er based control system installed within a house 
in accordance with the method and system of the 
present invention; 

Figure 2 is a high level block diagram depicting 
the major components of the computer based 
control system of the present invention; and 
Figure 3 is a high level logic flowchart which illus- 
trates a process for implementing the method 
and system of the present invention within a com- 
puter. 

With reference now to the figures and in particu- 
lar with reference to Figure 1 , there is depicted a pic- 
torial representation of a computer based control sys- 
tem installed within a house 1 0 in accordance with the 
method and system of the present invention. As illu- 
strated, house 10 may comprise a substantial number 
of rooms or separate physical locations such as 
rooms 12, 14, 16, 18. 20. 22, 24, 26. and 28. Located 
at a central location within each of these rooms is a 
verbal command detection device, such as a micro- 
phone. Thus, microphone 32 is located within room 
12. Microphone 34 is located within room 14 and each 
room recited above includes a corresponding micro- 
phone which may be utilized to detect verbal com- 
mands uttered within that physical location. 

For purposes of illustration, a lighting fixture is il- 
lustrated within each room or physical location within 
house 10. Thus, lighting fixture 52 is located within 
room 12. Similarly, lighting fixture 56 is located within 
room 16, lighting fixture 62 is located within room 22 
and lighting fixture 68 is located within room 28. Of 
course, those skilled in the art will appreciate that 
while a lighting fixture is utilized to illustrate the con- 
trol of a specified function by the computer based 
control system of the present invention, alarm sys- 
tems, appliances or other similar functions may also 
be controlled utilizing the method and system of the 
present invention without departing substantially 
from the spirit and intent of this disclosure. 

Located at a central location within house 10 is a 
computer 70. Computer 70 may be implemented util- 
izing any suitable computer, such as a so-called "per- 
sonal" computer, such as the Personal System/2 
computer manufactured by International Business 
Machines Corporation of Armonk, New York. 

As will be illustrated herein, a function control 
bus will be provided between computer 70 and each 
specified function to be controlled utilizing the com- 
puter based control system of the present invention. 
Those skilled in the art will appreciate that the func- 
tion control bus may constitute a so-called "hard- 
wired" bus or a series of radio frequency receivers 
disposed at each specified function location which 
are capable of being operated remotely by a radio fre- 
quency transmitter provided in association with com- 
puter 70. Additionally, circuitry coupling the output of 
each microphone within house 10 to personal com- 



puter 70 will be provided in a manner which will be de- 
scribed in greater detail herein and which is not illu- 
strated within Figure 1. 

Referring now to Figure 2 there is depicted a high 

5 level block diagram which illustrates the major com- 
ponents of the computer-based control system of the 
present invention. As illustrated, each microphone 
32-48 is preferably coupled to an analog-to-digital 
converter 72. Of course, those skilled in the art will 

10 appreciate upon reference to the present specifica- 
tion that conversion to digital format may not be nec- 
essary; however, the manipulation of digital values 
within a personal computer presents various advan- 
tages. 

15 Next, the output of each analog-to-digital conver- 

ter 72 is coupled to serializer 74. Serializer 74 may be 
provided utilizing any suitable circuit capable of ar- 
ranging the outputs of each analog- to-digital conver- 
ter 72 into a format suitable for coupling to computer 

20 70. Additionally, in the depicted embodiment of the 
present invention, serializer 74 will preferably provide 
a time stamp value to be associated with each output 
of an analog-to-digital converter 72, in order to deter- 
mine whether or not a plurality of verbal commands 

25 detected utilizing microphones 32-48 are uttered in a 
substantially simultaneous manner, indicating that a 
single spoken utterance has been detected at multi- 
ple microphones. Of course, those skilled in the art 
will appreciate that upon the coupling of each output 

30 of an analog-to-digital converter 72 to* computer 70 
via serializer 74, slight differences in time will neces- 
sarily occur; however, it is contemplated that any 
spoken utterance which occurs within several milli- 
seconds of another detected spoken utterance may 

35 be considered to be a simultaneous utterance for pur- 
poses of this invention. 

Next, computer 70 analyzes the output of each 
analog-to-digital converter 72 in comparison with pre- 
viously stored verbal command templates, which are 

40 utilized to determine whether or not a verbal com- 
mand detected at a microphone 32-48 is recognized 
as a verbal command for which this system has been 
trained. Again, those skilled in the speech recognition 
art will appreciate that the creation of training tern- 

45 plates containing those verbal commands which are 
to be recognized by a computer based control system 
which utilizes verbal commands is a simple matter 
and merely comprises the generation of multiple tem- 
plates for each verbal command, the averaging of 

so those templates to achieve a nominal value and the 
specifying of variances which will be permitted from 
that nominal template. 

Next, after determining that a verbal command 
detected at microphones 32-48 is a recognizable ver- 

55 bal command, computer 70 may also be uulized to de- 
termine whether or not the detected verba! command 
includes utterances by more than one speaker. It is 
contemplated that two speakers in s^narate areas 
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within house 10 may utter a similar verbal command 
substantially simultaneously and thus it is important 
to determine whether or not multiple speakers have 
generated the detected verbal command. Again, 
those skilled in the speech recognition art will realize s 
that the detection of multiple speakers in such a sys- 
tem is simply a matter of determining whether or not 
the speech recognition template utilized to recognize 
a particular verbal command is identical to a speech 
recognition template utilized to recognize a verbal 10 
command from a second speaker at a second loca- 
tion. Additionally, in systems which utilize a single 
generic template for the recognition of verbal com- 
mands, there are sufficient audible differences be- 
tween individual speakers that the existence of mul- 1 s 
tiple speakers may be easily accomplished. 

Next, in accordance with an important feature of 
the present Invention, amplitude comparison 78 is 
performed within computer 70 to determine the phys- 
ical location of each verbal command detected at mi- 20 
croptiones 32-48 which possesses the maximum vol- 
ume for a particular verbal command. That is, the sin- 
gle physical location detecting the greatest volume of 
a verbal command, in the case of a single speaker, or 
the location having the maximum volume associated 25 
with each individual speaker, in the event multiple 
speakers simultaneously utter a verbal command. 
Thereafter, a control signal is output via function con- 
trol bus 80 to control a specif ied function over a wired 
bus or radio frequency link, as described above. 30 

Thus, in accordance with the method and system 
of the present invention, a verbal command detected 
within the system will be analyzed to determine the 
physical location at which the maximum volume oc- 
curs and computer 70 will thereafter control the spe- 35 
cif ied function associated with that verbal command 
at only that location. In this manner, the simple com- 
mand "LIGHTS ON" may be utilized to control a light- 
ing fixture within any room within house 10, without 
requiring the verbal specification of particular lighting 40 
fixtures and without requiring the increased complex- 
ity that nonlocation dependent interpretation of verbal 
commands engenders. 

Finally, referring to Figure 3, there is depicted a 
high level logic flowchart which illustrates a process 45 
for implementing the method and system of the pres- 
ent invention within a computer. As depicted, the proc- 
ess begins at block 100 and thereafter passes to 
block 102. Block 102 illustrates a determination of 
whether or not a possible verbal command has been so 
detected and if not, the system merely iterates until 
such time as a possible verbal command is detected. 
Once a verbal command has been detected, the proc- 
ess passes to block 104. 

Block 104 illustrates the time stamping of each 55 
possible verbal command for determination of wheth- 
er or not a series of detected verbal commands are to 
be considered substantially simultaneous, for purpos- 



es of interpretation. Thereafter, the process passes to 
block 106. Block 106 illustrates a determination of 
whether or not the verbal command detected is rec- 
ognized as an appropriate verbal command for the 
computer based control system of the present inven- 
tion. If not, the process returns, in an iterative fashion, 
to block 102 to await the occurrence of a subsequent 
possible verbal command. 

Still referring to block 106, in the event a verbal 
command has been recognized, the process passes 
to block 108. Block 108 illustrates a determination of 
whether or not the recognized verbal command is a 
single command from a single speaker. As described 
above, this may be accomplished by determining that 
multiple recognition templates have been identified 
as corresponding to various detected verbal com- 
mands within a single utterance or, in the event of a 
speech recognition process which is speaker inde- 
pendent, by recognizing various differences in the 
output of multiple anaJog-to-digital converters 72. In 
the event the verbal command recognized is the ut- 
terance of a single speaker, the process then passes 
to block 110. 

Block 110 Illustrates a determination of the max- 
imum volume location for the verbal command., Of 
course, this may be simply and efficiently accom- 
plished by comparing the maximum digital value 
which occurred during a group of substantially simul- 
taneous verbal commands. Thereafter, the process 
passes to block 112 which illustrates the control of the 
specified function at only the maximum volume loca- 
tion. The process then passes to block 114 and^n*- 
turns. 

Referring again to block 1 08, in the event a deter- 
mination is made that multiple speakers have sub- 
stantially simultaneously uttered a single command, 
the process passes to block 116. Block 116 illustrates 
the determination of the maximum volume location 
for each identified speaker and the process then 
passes to block 118. Block 118 illustrates the control 
of the specified function at each maximum volume lo- 
cation associated with a particular speaker and the 
process then passes to block 114 and returns. 

Upon reference to the foregoing, those skilled in 
the art will appreciate that the Applicant herein has 
provided a simple and efficient technique for imple- 
menting a location dependent verbal command exe- 
cution system within a computer based control sys- 
tem. By detecting each possible verba! command at 
multiple physical locations throughout the installation 
and thereafter controlling a specified function at only 
the physical location having the greatest detected vol- 
ume, the method and system of the present invention 
greatly decreases the complexity of a verbal com- 
mand system while increasing the ef f iciency thereof. 



4 



EP 0 653 701 A1 



Claims 

1. A method for location dependent utilization of 
verbal commands uttered by users in a computer 
based control system for controlling at least a 
specified function at each of a plurality of physi- 
cal locations within an installation, said method 
comprising the steps of: 

detecting a verbal command at each of a 
plurality of physical locations within said installa- 
tion; 

determining a volume of said verbal com- 
mand at each of said plurality of physical loca- 
tions within said installation; 

identifying a selected physical location 
within said installation having a highest volume 
for said detected verbal command; and 

controlling said specified function at only 
said selected physical location. 

2. The method according to Claim 1 , further includ- 
ing the step of comparing each verbal command 
detected at each of a plurality of physical loca- 
tions within said installation to determine a num- 
ber of users uttering said verbal command sub- 
stantially simultaneously. 

3. The method according to Claim 2, wherein said 
step of identifying a selected physical location 
within said installation having a highest volume 
for said detected verbal command comprises the 
step of identifying a selected physical location 
within said installation having a highest volume 
for each detected verbal command uttered by 
each of said number of users. 

4. The method according to Claim 3, further includ- 
ing the step of controlling said specified function 
at only said selected physical location within said 
installation having a highest volume for each de- 
tected verbal command uttered by each of said 
number of users. 



means for controlling said specified func- 
tion at only said selected physical location. 

6. The system according to Claim 5, further includ- 
5 ing means for comparing each verbal command 

detected at each of a plurality of physical loca- 
tions within said installation to determine a num- 
ber of users uttering said verbal command sub- 
stantially simultaneously. 

10 

7. The system according to Claim 6, wherein said 
means for identifying a selected physical location 
within said installation having a highest volume 
for said detected verbal command comprises 

15 means for identifying a selected physical location 

within said installation having a highest volume 
for each detected verbal command uttered by 
each of said number of users. 

20 8. The system according to Claim 7. further includ- 
ing means for controlling said specified function 
at only said selected physical location within said 
installation having a highest volume for each de- 
tected verbal command uttered by each of said 

25 number of users. 

9. The system according to Claim 5, wherein said 
means for detecting a verbal command at each of 
a plurality of physical locations within said instal- 

30 lation comprises a microphone disposed within 

each of said plurality of physical locations within 
said installation. 

10. The system according to Claim 9, further includ- 
35 ing an analog-to-digital converter coupled to each 

microphone disposed within each of said plurality 
of physical locations within said installation. 
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5. A computer based control system for location de- 
pendent utilization of verbal commands uttered 45 
by users and for controlling at least a specified 
function at each of a plurality of physical loca- 
tions within an installation, said computer based 
control system comprising: 

means for detecting a verbal command at so 
each of a plurality of physical locations within said 
installation; 

means for determining a volume of said 
verbal command at each of said plurality of phys- 
ical locations within said installation; 55 

means for identifying a selected physical 
location within said installation having a highest 
volume for said detected verbal command; and 
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